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This paper presents a verifiable model-reference adaptive control method based on an optimal control 
formulation for linear uncertain systems. A predictor model is formulated to enable a parameter estimation 
of the system parametric uncertainty. The adaptation is based on both the tracking error and predictor error. 

Using a singular perturbation argument, it can be shown that the closed-loop system tends to a linear time 
invariant model asymptotically under an assumption of fast adaptation. A stability margin analysis is given 
to estimate a lower bound of the time delay margin using a matrix measure method. Using this analytical 
method, the free design parameter v of the optimal control modification adaptive law can be determined to 
meet a specification of stability margin for verification purposes. 

I. Introduction 

Adaptive control is a promising technology that can improve performance and stability of an uncertain system. 
The ability to accommodate system uncertainties and to improve fault tolerance of a control system is a major selling 
point of adaptive control since traditional gain-scheduling or fixed-gain controllers are viewed as being less capable 
of handling systems with uncertainty. In spite of the advances made in the field of adaptive control, there are several 
challenges related to the implementation of adaptive control technology in safety-critical systems. The absence of 
the verification and validation methods of adaptive control systems remain a major hurdle to the implementation 
of adaptive control in safety-critical systems. 1,2 This hurdle can be traced to the lack of performance and stability 
metrics for adaptive control which poses a major challenge that prevents adaptive control from being implemented in 
safety critical systems. The development of verifiable metrics for adaptive control will be important in order to mature 
adaptive control technology for use in operational safety-critical systems. Of these, stability metrics of adaptive control 
are an important consideration for assessing system robustness to unmodeled dynamics and exogenous disturbances. 
In one aspect of verification and validation, a control system is usually certified by demonstrating that it meets an 
acceptable set of requirements or specifications for stability margins, among other things. Herein lies a major challenge 
for verification and validation as there is no existing standard tool for stability margin analysis of nonlinear adaptive 
control. The lack of stability metrics for adaptive control is viewed as a technology barrier to developing certifiable 
adaptive control for safety-critical systems. 1,2 

Classical LTI control systems are certified by demonstrating that they meet specifications for stability margins 
among other things. Typically, certification requirements for flight control systems, such as MIL-F-9490D, are often 
addressed in terms of phase and gain margins. These margins are used for LTI control laws to provide robustness 
or safety margins in a control system design as a safeguard against unmodeded effects and unstructured uncertainty. 
While the gain margin concept has been extended to adaptive control, 3 the phase margin concept does not easily lend 
itself to adaptive systems due to the inherent nonlinearity in adaptive control. Strictly speaking, phase margin for 
adaptive control in a global context as in the LTI framework is not possible, but it may be possible to approximate a 
phase margin locally using linearization or other equivalent methods. 4 Time delay margin has been viewed as a more 
readily accepted metric for relative stability of nonlinear control. While time delay margin is a suitable stability metric 
for adaptive control, a current challenge is that there is no well-established analytical tool for computing the time delay 
margin. 

Verifiable adaptive control must be able to provide measures of stability margins and performance metrics by 
analytical means. The presence of analytical methods for analyzing stability and performance of an adaptive control 
law will enable a designer to conduct the design of an adaptive controller using an analytical approach as opposed to 
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an ad-hoc trial-and-error process that is typically done. Currently, there is no adaptive control method that can provide 
any analytical stability margin for nonlinear uncertain systems. On the other hand, for linear uncertain systems, 
the Jz?i adaptive control method can provide both stability and performance measures under the assumption of fast 
adaptation. 5-6 The stability margin of the Jzfj adaptive control is then governed by the choice of a low-pass filter 
implementation. 

This paper presents another possibility for verifiable adaptive control based on the use of the optimal control 
modification adaptive law that was recently developed. 7 This method provides a modification to model-reference 
adaptive control to improve robustness to unmodeled dynamics and other unknown disturbances. The adaptive law 
was derived from the optimal control theory to minimize the Jz? 2 -norm of the tracking error. It should be mentioned 
that there are other recently developed modifications to adaptive control such as the adaptive loop recovery method, 8 
Kalman filter modification, 9 and (2-modification. 10 

In the context of verifiable adaptive control, the optimal control modification exhibits an interesting property. 
Using a singular perturbation argument for fast adaptation, it can be shown that the asymptotic solution of the adaptive 
law for a linear uncertain system actually tends to a LTI model. This asymptotic linearity affords a certain advantage 
that can allow analytical methods to be developed for analyzing stability margins. This behavior will be explored 
in this paper. The design approach for linear uncertain systems developed herein is based on a combined adaptation 
to minimize both the tracking error and predictor error. A number of adaptive control methods that utilize predictor 
models include the adaptive control, composite model -reference adaptive control, 11 and ML adaptive control. 12 
The predictor model is utilized to enabled the control input uncertainty to be estimated. Under fast adaptation, the 
optimal control modification provides an analytical expression to compute the minimum time delay margin of the 
system that is lower-bounded by a non-zero value. This behavior is very similar to the Jz?i adaptive control even 
though the approach is entirely and uniquely different. 

II. Optimal Control Modification Adaptive Law 

Consider a linear plant with control input uncertainty and linear matched uncertainty 

x = Ax + BA (^u + 22* T x^ (1) 

where x(t) : [0,°o) — > R" is a state vector, u (f) : [0,°°) — ■> is a control vector, A G M” x " and B G R nxp , p > n, are 
constant and known matrices such that the pair ( A,B ) is controllable, A = A T > 0 G R pxp is a constant and unknown 
diagonal matrix with positive diagonal elements, and 22 G R nxp is a constant and unknown matrix that represents a 
matched parametric uncertainty.. 

A nominal fixed gain controller has been designed to stabilize the nominal plant with A = I and (2* = 0, and to 
enable it to track a command r(t) 

Unom — A\,V T K r r (2) 

where r(t) : [0,°°) — > R r G 2z?c» is a piecewise-continuous and bounded command vector, A — BK X G M" x " is Hurwitz, 
and BK r G R" xr , r < n. 

The closed-loop nominal plant without uncertainty is 

x = A m x+B m r (3) 

This closed-loop nominal plant is then used to specify a reference model 

Xm = A m.\ m T B m Y (4) 

where x m ( t ) : [0, °°) — > R n is a reference state vector, and A m = A — BK X and B m = BK r . 

Since r(t) is bounded, then x m (t) can be shown to be uniformly bounded such that 

||*m(0)|| < £ => ||x m (f) || < <5 (e) , Vf > 0 (5) 

The objective is to design a full-state feedback adaptive augmentation controller to enable x(t) to follow x m ( t ) in 
the presence of uncertainty due to A and (2* with the following controller 

u = u nom — A K x x + A K,r — f2 T x (6) 

where A K x (; t ) : [0, °°) -> R' ,xn , AK, ( t ) : [0, °°) -► R pxr , and (2 (t ) : [0, °°) -> R nxp . 
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For convenience, u (?) can be expressed as 


,-© T <I> 


(7) 


where © T = 


AK X + Q. -A K r 


and <F = 


lT 


Assumption 1: There exist constant and unknown A K* and A K* such that the following conditions are satisfied 


A (K x + AK* ) = K x (8) 

A(K r + AK*) = K, (9) 

Let A = A — A, A K r = A K r — AK*, A K x = A K x — AK*, and Q Q — Q* . Then the closed-loop plant becomes 

x = A m x+B m r+BA (^—AK x x+AK r r — Q. T x'j —BA ^—AK x x + AK r r — Cl T x^j (10) 

or 

x = A m x + B m r-BA® T <P + BA& T <t> (11) 

Defining the tracking error as e ( t ) = x m ( t ) — x(t), then the tracking error equation becomes 

e=A m e + BA® J <P + Be (12) 

where e (x) :: R" — > K" is the estimation error 

e = -A0 t T> (13) 

The standard MRAC adaptive law for adjusting © is given as 

© = ^r0<Fe T PfisgnA (14) 


This MRAC law, while providing asymptotic tracking, does not provide robustness to potential unmodeled dynam- 
ics. Optimal control modification adaptive law has been developed to address robustness and can be used to provide 
the adaptation as follows: 

© = -r©4> (e J P - v<P T ®A J B J PA m 1 ) BA (15) 

It is noted that the adaptive law depends the estimate of A which needs to be computed. Toward this end, a predictor 
model of the plant is defined as 

x = A m x+ (A —A m )x + BA ^n + 0 T xj (16) 

x = Ax + BA (u + QJx— (17) 

Defining the predictor error as e p (t) = x(t) —x(t), then where 

S p = -Af2 T x (18) 

Proposition 1: The following adaptive laws 

Q = -r n x (ejp - vx T ak T B r PA m 1 ^ BA (19) 


a 1 = -r A 


+ e JP—v(u T +x T £lj 


a t b t pa: 


b 


( 20 ) 


is an approximate solution of an optimal control problem that minimizes the following an infinite-time horizon cost 
function 


J = 


lim 



1 

2 



A ) J Q(e p 


A )dt 


( 21 ) 


where A (?) : [0, °°) — >■ K" is a lower bound of the tracking error, rn = r £ l i >06 R” x " and Ta = rj >0 g M. pxp are 
adaptive gain matrices, v > 0 € R is a free design parameter, and P = P T > 0 € R" x " that solves 


PA m +Aj n P — —Q 


( 22 ) 
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where Q = Q T > 0 £ R” x ". 

Proof: The cost function J is convex and represents the distance measured from a point on the trajectory of e p (t) 
to the normal surface of a hypersphere B\ = {e p (f) £ R" : \\e p (t) || < || A|j } C @ C K”. The cost function is designed 
to provide robustness by not seeking an asymptotic predictor error that tends to zero but rather one that tends to some 
lower bound away from the origin. By not requiring e p (t) — » 0 as t — » the adaptation can be made to be robust. 
Therefore, the tracking performance can be traded with robustness by a suitable selection of the tuning parameter v. 

An optimal control problem can be formulated by the Pontryagin’s Minimum Principle. Define a Hamiltonian 
function 


H (e p ,p,A,Cl) = - (e p - A) T Q (e p - A) + p 1 


A m e p + BA (u- j- O, xj-\- BA£1 x H- Be p 


(23) 


where p (t) : [0,<=°) — » K" is an adjoint variable, then the adjoint equation can be established by the following necessary 
condition 


P = ~ VH J P = ~Q ( e p ~ A ) ~ A mP 


(24) 


with the transversality condition p(tf —*° °) =0 since e (0) is known. 
Then the adaptive laws can be formulated by a gradient method as 13 


Cl = To V//q- — —Tqxp^BA 

(25) 

A t = — r^VH^ = — Ta (u + £2 T xj p r B 

(26) 


An “approximate” solution of p(t ) is obtained using a “sweeping” method 14 for the adaptive law for £2 by letting 
p = Pe p + SBAQ. r x. Then, the adjoint equation becomes 


Pe p + P 


A m 6 p BA (u~\~ 


+ BA (V2 T jc-£r T x) 


+ Be 


+ SBAQ.' x + SB- 


. d (£2 t ji 
dt 


= -Q(e p -A)-A, l 


Pe p +SBAQ.'x 


(27) 


which yields steady-state constant solutions of P and S as 

PA m +Aj n P + Q = 0 (28) 

S = -A m T P (29) 

Without any loss of generality, a free design parameter v > 0 £ R is introduced as a gain to allow for adjustments 
of the modification term in the adaptive law, where v = 1 corresponds to an optimal solution. Thus 

S = -vA m J P (30) 

Then the adjoint p is obtained as 

p = Pe p - vA m J PBACl T x (31) 

Substituting p into the gradient adaptive laws yields the adaptive law (19). The derivation of the adaptive law (80) 
can be done in a similar manner. 

Theorem 1: The adaptive laws (19) and(80) result in stable and uniformly ultimately bounded predictor error 
e p (t) for all (e p (0) ,Cl (0) , A(0)) £ B a with an ultimate bound 


P = 


where 


/ ^max ( P ) + X rn ax 1 ) + k,nax (r\ * ) u 

hum ( P) 


2 IIPBII £o 

r = 

^ min (Q) 

2||M m 1 ||£2 0 

^ / 

'A min ( Am 'QA 

m 


(32) 


(33) 

(34) 
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V = 


2||M m 1 ||A 0 
mu ^A WI QAm 


(35) 


with £q = supjg^ ||e p ||, O.Q = max||£2*j|, and Aq = max ||A|j. 
Proof: Choose a Lyapunov candidate function 


Cpl c p 


V = eJ,Pe D + trace + trace ^Ar A 1 A T ^ 


(36) 


Evaluating V yields 


V — el ( A rn P + PA m )e p + 2e~[P 


BA {u + £2 T xJ + BACl 1 x + B£p 

r. / -f- \ -r- 

— 2trace 


ST. 


— 2trace 


QJxeJPBA - vfVxAflV B'PAj BA 


A[u + Qj x) eiPB -vA 


^M + £2 T xj ^ 


u T +x t Q.) A t B t PA-Jb 


(37) 


Using the trace identity trace (A B) = BA , V can be written 


as 


V = -ejQe p + 2ej,P 


BA 


(h + £2 t x) +BAQ? 


X “h BSr, 


- 2 el PB Ail 1 x + 2v.G ilk' B l PA,' BAil 1 x 


- 2e' p PBA 


(u + Q. T xj +2v (m t +x J Q^j A t B t PA~ 1 BAA (u + Q. J xj (38) 


The sign-definiteness of the term PA,,, 1 is now considered. Recall that a general real matrix G is positive (negative) 
definite if and only if its symmetric part M = j (G + G T ) is also positive (negative) definite. Then, by pre- and post- 
multiplication of Eq. (22) by A“ T and A ~ 1 , respectively, PA,), 1 can be decomposed into a symmetric part M and 
anti-symmetric part N as 

PA m l =M + N (39) 


where 


^ = ^ (a- T P + PA-‘) = --A~ T QA~ l 
(PA m l 


N = 


-A“ t P 


(40) 

(41) 


Since the symmetric part M < 0, then PA m l < 0. Thus, V becomes 

V = -e J pQep + 2 eJPBe p + 2 vx T (£2* + Cl) A T B T (. M + N) BACl T x 

A~ 2v ( iK T 


^m t +x t £2^ (A + A) T B t (M + N) BA + £2 T xj (42) 


Using the property y'Ny = 0 for an anti-symmetric matrix N, V is reduced to 
V = -el Qe p + 2el I 1 Be,, + 2vx' iYA 1 fi 1 PA m 1 BAil T x - Vx 1 ClA 1 B 1 Aj QA~ 1 BAil 


(m t +x T Q}j A t B t PA~ 1 BA (u + Q. T x^j - V (u J + x T lf) A T B T A m T QA m x BA (n + £2 T x) (43) 


+ 2 v[u + x £2 ) A B PA 
which is bounded by 

v < - ||e p || [Kin (G) \\e p \\ -2 ||PP|| So] - v ||x|| 2 ||pA|| 2 ||fij 

1 2 


— V 


U + Pl T X 


B 


Kin i^Am QA,n 

nin i^A-m Q^m 


H|| -2||PA m 1 ||£2 0 

A|| -2||PA,), 1 ||Ao 


Let 


where 


B r = { (e p ,£2, A) £ K" x M! ,xp x M. pxp : ||e p || < r or ||£2|| < icor ||A|| < u} 

m I, ^ _ 2 ||PP|j e 0 

l]ep ' l ~ r Kin(Q) 


(44) 

(45) 

(46) 
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n < k = 


A < v = 


2 IIM - 1 ||n 0 


2 PAj A 0 
nin (^A-m t qa m 


It follows that V < 0 for all (e p ,Cl, A) G Br — B,-, where Br = {e p G R" : ||e p || < /?} C Let Bp be the smallest 
subset that encloses B r , then there exists j3 > 0 where 


such that 


P — kmax (P ) r2 + Kax (Lq 1 ) K~ + Kax (r^ 1 ) V~ 


B r cfi, 3 = { (e p ,Cl,A) efx R nxp x R pxp : V < /3 } 


Let be the largest subset enclosed by Br, then since e p <R in Br, there exists a > 0 where 


Kin (P) ||e p || 2 < Inin (P) \\e p f + Kin ^0') || Cl \f 2 + Kin (r~ 1 ) ||Af < V < Kin (P) R 2 = « (51) 


II A II 2 . 


such that 


B a = { (e p ,Cl,A) G K" x U. nxp x R pxp : V < a} C B R 


Then for a solution to be uniformly bounded, the set containment is as follows: 


B, C Ba CB a CBr 


This implies 


Therefore 


P < a Kax ( P ) r 2 + Kax (r a ') K 2 + Kcx (r/) U 2 < Kin ( P ) R 2 


Kax (P) f 2 p Kax {Pq 1 ) K 2 + Kax V- 

fl> v LLW =p <55) 

where p is the smallest value of R. 

Then p is the ultimate bound of e p (t) such that 

r<\\e p (t)\\< p <R (56) 

Since V < 0 for all (e p .£l. A) G BR — B r , therefore V is a decreasing function of time outside of B r . Thus, if 
( e p (0) ,£2(0) ,A(0)) G B a , the solution will eventually entersB^ after a finite time t = T (independent of (e p (0) ,£2(0) ,A(0)) 
and a) and remain inside for all t > T. 15 Therefore, e p (t) is uniformly ultimately bounded with an ultimate bound p. 


III. Transient and steady state performance 

It can easily be shown using the Lyapunov analysis above that the tracking error is bounded by 


IkWIUu < 


' \ max (P) W 2 + 'Knax (T© 1 ) ^ 
^ min ( P ) 


2||ra||sup^||e|| 

* a — <58) 

2 IlM” 1 II max 110* I 

" _ T a ( 59) 

Ktin ( A m QA m J 

Thus, ||e(f)||_ s? oc Kax (r® 1 )- Increasing r© gives better transient and steady state tracking performance. 
However, that will come at the expense of robustness. Optimal control modification adaptive laws provide stability 
margins to improve robustness even when T© is large. 
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Similarly, the predictor error is bounded by 




I 'Knax (-P) T 2 + X max (r^ 1 ) K * 2 + kmax (T A 1 ) V 2 

^ min (p) 


(60) 


Increasing the adaptive gains r_o and r A results in better convergence of the parameter estimation of Cl* and 
A. With optimal control modification, the adaptive gains can be set as large as numerically feasible to obtain better 
parameter convergence without adversely affecting stability robustness of the parameter estimation algorithms. 

Numerically speaking, if the Euler integration method is implemented with a time step At, there exists a maximum 
value of r© to maintain numerical stability. This is a well-known result in numerical analysis. For the tracking error 
adaptation, an approximate numerical limit of T© based on a given sampling frequency f s is given by 


hmax (E© ) A 


|<M> T | 




2 fs 

\\A t B t PA m l BA\ 




(61) 


The norm 1 1 <E><T> || can be estimated based on x m instead of x, but this would tend to yield a non-conservative 
estimate. Similarly, the norm ||A t .B t PA“ 1 .BA||^, can be approximated by ||_B t PA„ j 1 ,B|| j ^ which is a conservative 
estimate. 


IV. Stability Margins 

The tracking error equation can also be written as 

e = A m e + BA0 T <t> — BA©* T <t> — BA© T <t> (62) 

Now consider a time-scale separation problem when ||F© || = ® ||A m || where e is a small parameter. Then ©(f) 

is said to be a fast state and e ( t ) is a slow state. To decouple the fast and slow states, a time-scale separation can be 
performed by applying the singular perturbation method using a time transformation 

X = et (63) 


where T is a slow time variable. 

Then, the system is transformed into a singularly perturbed system as 


de 

dx 



e + BA0 t <I> - fiA0* T 4> - BA0 T <t> 


(64) 


£ d ^^~^®( eT P-V® T ®A T B T PA. m ^BA (65) 

The Tikhonov’s theorem can be used to approximate the solution of the singularly perturbed system with the 
solution of a “reduced-order” system by letting e — > 0. 16 Then, © (e. e) is on a fast manifold. Thus, the reduced-order 
system is given by 


,d& 

dx 


-y©4> (. 


e T P- v<S> T ®A r B r PA, 


BA => (fiA0 T <l>) (0) = ^p- l Aj n Pe W 


e (0) = A m e (0) + W - (fiA0* T <I>) W - (fiA© T <l>) 

where A 01 (f) and (fi© T <J>) l °' 1 (f ) are the “outer” solutions of the singularly perturbed system. 
The “inner” or “boundary layer” solution for this system is obtained from 


( 0 ) 


, ( 0 ) 


© ( o = 


e (i)J P-v (<& T ©A T ,B T ) 


PA - 


BA [1 > 


( 66 ) 

(67) 


( 68 ) 


e — = A m e + BA® T <t> - BA®* J <S> - BA0 t T> => A m e (i) 
dx 


(fiA0 T <l>) <0 - ( fiA0* T <l> ) U1 - (fiA© T <l>) U 


0 (69) 
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The general solution of the system is then expressed as 

e ( t ) = ( t ) + e W (f ) - e M AE 0 ) (70) 

where cmae (t) is a correction term by a matched asymptotic expansion method applied to both the inner and outer 
solutions. 17 The outer solution is in fact the asymptotic solution of the original system as t — » <=°. For the singularly 
perturbed system comprising A 0 ) (f) and (B© <!>) *° (f), the outer solution of the tracking error is then determined by 

e (0) = +BK^-AK*x + AK*r-£l* J X s ) +A (71) 

where A is the residual uncertainty 

A = BA ( - A K x x + A K,-r - £2 T x) (72) 

which interestingly enough is an LTI system. 

Since the asymptotic tracking error equation for the outer solution is LTI, many standard LTI analysis tools can be 
used to estimate the asymptotic behavior of the original system. In particular, the design parameter v can be selected 
to provide a notion of stability margin for the outer solution to account for the residual uncertainty A. 

Let A A = BALI x and A B = B (A — /), then the plant can also be written as 

x = {A + AA)x + (B + AB) u (73) 

From the model matching conditions, we have 

BAAK* = B (/ - A) K x = -A BK X (74) 

BAAK* = B (/ - A) K r = -A BK r (75) 

Therefore, the asymptotic tracking error equation becomes 

e (0 > = A + AA-{B + AB)K x +^p- l Aj n P — (AA — ABK X ) x m — ABK,r + A (76) 

A similar singular perturbation argument can be applied to the predictor model to obtain an asymptotic predictor 
model under fast adaptation. The asymptotic predictor model can be shown to be 



which is also a LTI model and interestingly enough does not depend on plant uncertainty. 

The projection operator can be applied to the adaptive laws with a priori knowledge of the bounds on the elements 
of 0, £2, and A. Using these a priori bounds, the design parameter v can be selected to guarantee stability robustness. 
Then the adaptive laws are modified by the projection operator as follows: 

0 = -r @ Proj (©,<!> (e J P - v^QA^B^PA-^BA} (78) 

Cl = -r n Proj (q.,x (ej,p - vx T ak T B T PA m 1 ^ Ba) (79) 

A T = -r A Proj (a, (m + £2 t x) eJP-v(u T +x T ^A T B T PA~ 1 B^j (80) 

The free design parameter v can now be estimated to give the asymptotic closed-loop tracking error model a 
desired measure of stability robustness such as phase or time delay margin to account for the residual uncertainty 
and any other unmodeled dynamics. One method for estimating a MIMO phase or time delay margin is based on the 
matrix measure method which is given as follows: 

In the presence of an input delay, the closed-loop tracking error becomes 

^°)(0 = (A + AA)e(°)(0- (B + AB)K x ~^P~ l Aj n P e (0) (t -t d ) - (AA - ABK x )x m (t -t d ) - ABK r r (t -t d ) (81) 
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(82) 


The MIMO phase and time margins can be estimated by 

_ , JJ (A ■ + AA) + Ji (j [OB + A B) K x - \P~ l AlP] ) 

0 = COS n i ; — — — 

\\(B + AB)K x -lp- l Aj n P\\ 

t = t 

dm V (-JA - jAA) + 1 1 (B + AB) K x - l -P~ 1 Aj n P\ \ 
where jl as the maximum eigenvalue of a symmetric part of a general complex matrix C 

p(C) = k max ( C+ 2 C *^J ( 84 ) 

where C* is the complex conjugate of C. 

Utilizing this equation, the free design parameter v can then be estimated to provide a measure of a time delay 
margin in an asymptotic sense. Similarly, the free design parameter v can also be estimated to guarantee stability 
robustness of the predictor model adaptive laws. 

Example: Consider a stable first-order plant coupled with a second-order unmodeled plant with two highly 
damped poles which could represent a structural mode 

x = — x + 2u — 0.1y + 0.1w(f) 

y + 2£co n y+a> n y = lx 

where £ = 5, ft),, = 10, and — 1 < w(t) < 1 is a white noise signal representing a sensor noise source. 

The reference model is 

x m = -2x m + 2 r 

where the reference command is a step input with a small sinusoidal variation at the same frequency as ft),,. 

r = 1 +0.5 sin co n t 


The controller is given by 


where <f> (t) 


x{t) 


r{t) 


H T 

and ©(f) 


u = -0 T <I> 


o,(t) 


e r (t) 


-I T 

is updated by 


©= -r + v<f><t> T ©^ 
with e (f ) = x m (f ) — x (f), © (0) = 0, and F = 1007. 

The conventional MRAC, i.e., v = 0, causes © (f ) and x (f) to be on the verge of instability as shown in Figs. 1 and 
2 even though the open-loop plant is stable. 


Standard MRAC, r=100 

2# T — , T 



-20 1 1 1 1 1 

0 20 40 60 80 100 

t 
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Fig. 1 - ©(f) with MRAC, v = 0 


Standard MRAC, r=100 



Fig. 2 - Output with MRAC, V = 0 

A value of v = 0.8 is chosen, the optimal control modification is able to produce a stabilizing controller, as seen in 
Fig. 3. Thus, this illustrates the robustness of the optimal control modification. As a comparison, the e-modification 
is used instead for the update law 

© = — r (<f>e + ju |e| 0) 

with ji = 0.8. The adaptive signal is stable as shown in Fig. 4. 

The asymptotic tracking error equation for fast adaptation is 

u (0) _ e — 


The asymptotic closed-loop plant can be expressed as 


sx = — x + 2 - 


0.7x 


v s 2 + 2£co n s+co 2 


s+H (-■ 


As t 


0.7 


'2 t^co„s + co * 


r(°) = 


4 r 


v(s + 2) 


d°) } 2 col 

r (v + 2) ©,7 + 0.7 V 


Figure 3 illustrates the linear mapping between x !(): and r for three different multipliers 0.1, 0.5, and 1.0 that scale 
the input signal. The predicted asymptotic ratio of to r is 0.7129, which agrees reasonably well with the simulation 
results. Fig. 4 shows response due to the £-modification which produces a nonlinear mapping between x 1 - 0 - 1 and r. 
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Optimal Control Modification, r=100, v=0.8 



Fig. 3 - Output with Optimal Control Modification, v = 0.8 
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Fig. 4 - Output with e- Modification, jj. = 0.8 


V. Flight Control Simulation 

Consider a longitudinal pitch dynamical model of an aircraft 


mV + y 0 0 
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o £ 
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(85) 


A numerical model for a full-scale generic transport model (GTM) at Mach 0.8 and 30,000 ft with the flight path 
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angle y = 0 is given by 


a 


-0.7018 

0 

0.9761 


a 


-0.0573 

G 

= 

0 

0 

1 


G 

+ 

0 

q 


-2.6923 

0 

-0.7322 


q 


-3.5352 








N, 



V V 

A B 

A desired reference model of the pitch attitude is given by 

' 2^ CO/, G m ■ (O n G m = co n r (86) 


where £ = 0.85 and (O n = 1.5 rad/sec are chosen to give a desired handling characteristic, 
n T 


Let x = 


a G q 


*3 


«31 (On 2^CO„ + a- ii 


and u = 8 e . A nominal controller is designed as u nom = —K x x — k,-r where K x = 

and k r = — = 0.6365. The closed-loop eigen- 


0.7616 -0.6365 -0.5142 
values are —0.6582 and —1.2750 ±0.7902/. The nominal closed-loop plant is then chosen to be the reference model 
as 


a 


’ -0.6582 

-0.0365 

0.9466 


a 


' 0.0162 " 

6 

= 

0 

0 

1 


G 

+ 

0 

4 . 

m 

0 

-2.2500 

-2.5500 


q _ 

m 

1 


Suppose the control effectiveness is reduced by 50%, i.e., A = 0.5 and the matched uncertainty is represented by 



0 


0 


-0.2071 


which represents 11% increase in pitch damping and q contribution to a. 


Figures 5 is a plot of estimates of phase and time delay margins from the asymptotic solution computed from Eqs. 
(82) and (83) as a function of v. Note that the phase margin with AA and A B decreases steadily as v increases, while 
the time delay margin reaches a maximum at about v = 1 . Thus, for practical design purposes, v should be kept 
between 0 and 1 . A large value of v produces a better time delay margin, but also results in a poorer steady-state 
tracking. 

Suppose a requirement for a 0.02 sec time delay margin is imposed on the flight control design. Then from Fig. 5, a 
value of v = 0.2 is selected to provide a sufficient time delay margin of about 0.049 sec or about 60 deg phase margin. 
It should be noted that the time delay margin as computed from Eq. (83) is a conservative estimate corresponding to 
r© — > o°. So the actual time delay margin for a finite value of T© should be greater than the estimated value. 




Fig. 5 - Phase and Time Delay Margin Estimates 
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Figures 6, 7, and 8 show the a, 6, and q responses due to the baseline controller. With no adaptation, the plant is not 
able to track the reference model very well. For the standard MRAC, an adaptive gain of T© = 10000/ is used to enable 
a tight tracking of the pitch attitude reference signal. For parameter estimation, adaptive gains of To = Ta = 1000 1 are 
used. Both the a and 0 responses track the reference signals quite well. However, the q response is highly oscillatory 
during the first 15 sec. The numerical evidence of the time delay margin of the system with the standard MRAC is 
observed to be 0.04 sec. Figure 8 shows the responses with the optimal control modification for the same adaptive 
gains. The q response is significantly improved with almost no noticeable high frequency oscillations. The observed 
numerical evidence of the time delay margin with the optimal control modification is 0.09 sec, which is a significant 
improvement over that for the standard MRAC. 



t, sec 


Fig. 6 - a, G, and q Responses with Baseline Controller 




Fig. 7 - a, 9, and q Responses with Standard MRAC 
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t, sec 


Fig. 8 - a, 0, and q Responses with Optimal Control Modification (OCM) 



t, sec 


Fig. 9 - Elevator Deflection 

Figure 9 shows the control signals produced by the baseline controller, standard MRAC, and optimal control 
modification. The control signal produced by the standard MRAC exhibits large amplitude, high frequency oscillations 
in the first 15 sec. In contrast, this behavior is not seen with the optimal control modification which produces a well- 
behaved control signal. 


VI. Conclusions 

This study presents a verifiable model-reference adaptive control method based on an optimal control formulation 
for linear uncertain systems. A predictor model is formulated to enable a parameter estimation of the system parametric 
uncertainty. The adaptation is based on both the tracking error and predictor error. Using a singular perturbation 
argument, it can be shown that the closed-loop system tends to a linear time invariant model asymptotically under an 
assumption of fast adaptation. A stability margin analysis is given to estimate a lower bound of the time delay margin 
using a matrix measure method. Using this analytical method, the free design parameter v of the optimal control 
modification adaptive law can be determined to meet a specification of stability margin for verification purposes. 
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A simple scalar system is used to demonstrate the asymptotic linearity of the optimal control modification adaptive 
law when the system exhibits a linear input-output mapping under fast adaptation. A flight control application for 
a generic transport aircraft is studied. The simulation results demonstrate the effectiveness of the optimal control 
modification, which shows its ability to suppress high frequency oscillations in the control signal, thereby enabling 
improved robustness. The present method may provide a path toward addressing technical challenges with verification 
and validation of adaptive control. The ability to verify an adaptive control algorithm is an important step toward 
future certification of adaptive control for safety-critical systems. 
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